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DETAILED ACTION 
Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

Claims 1-15 and 17-30 are rejected under 35 U.S.C. 102(b) as being anticipated 
by Abrams, Marc et al. ("UIML: An XML Language for Building Device-Independent 
User Interfaces"). 

In regards to claim 1 , Abrams teaches, a method of scaling an application 
graphical user interface for display with any of a plurality of heterogeneous device 
platforms, the method comprising: 

a) creating an instance of an intermediate representation of a device platform 
independent application graphical user interface (i.e. "UIML can be viewed as a 
meta- or extensible language, analogous to XML. UIML does not contain tags 
specific to a particular user interface toolkit (e.g., <WINDOW> or <MENU>). 
Instead, it uses a set of generic tags (e.g., <part>, <property>). As discussed 
earlier, UIML captures the elements that are common to any user interface: an 
enumeration of the user interface parts, events that occur for those parts, 
presentation style, content, and interconnection to application logic. The UIML 
author specifies instance and class names of their own choice for interface parts 
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and events. These names are mnemonics for the interface implementor." Page 
5); 

b) dynamically customizing the intermediate representation as a function of the 
capabilities of one of the heterogeneous device platforms (i.e. "A UIML document 
can be used in one of several ways. First, it can be stored on a server (see 
Figure 1). When a user invokes an application, the UIML document either is 
compiled to a target platform's language (e.g., to WML, or to C++), or it is 
interpreted while the user interacts with the interface" Page 3); 

c) extracting a device platform dependent application graphical user interface 
from the customized intermediate representation (i.e. "Compilation on the server 
side is mandatory for devices that cannot download applications, such as cellular 
phones, and where memory is limited. Interpretation is more flexible; for example 
our Java interpretive renderer permits the entire UIML interface to appear as a 
Java bean, so that the interface may be manipulated programmatically by the 
application logic" Page 3); and 

d) displaying the device platform dependent application graphical user interface 
with said one of the heterogeneous device platforms (i.e. Figure 1, Page 4). 

In regards to claim 2, Abrams teaches a method dependent on claim 1, wherein 
b) comprises removing unnecessary tasks from the intermediate representation as a 
function of the capabilities of said one of the heterogeneous device platforms, (i.e. 
"Second, UIML can be dynamically generated from a database (see Figure 3). An 
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interface server can query the client for a list of device features and/or user preferences 
and dynamically generate the UIML code for the interface from a database query. The 
user gets a tailored ill that takes advantage of the technologies supported by the device 
without overloading the network or the device with unsupported code." Page 11). 

In regards to claim 3, Abrams teaches a method dependent on claim 1, wherein 
b) comprises transforming the intermediate representation as a function of the 
capabilities of said one of the heterogeneous device platforms (i.e. u Dynamic Interfaces 
are interfaces that are generated on-the-fly and are usually custom-made for each user 
or device. There are two reasons why dynamic interfaces are becoming very popular 
First there is a plethora of devices available in the market today and users maybe 
accessing an application with anyone of them. 11 Page 10). 

In regards to claim 4, Abrams teaches a method dependent on claim 1, wherein 
a) comprises migrating a scalable application to a mobile device, the scaleable 
application comprising the device platform independent application graphical user 
interface (Figure 1 , Page 4, Device #2). 

In regards to claim 5, Abrams teaches a method dependent on claim 1, wherein 
a) comprises representing at least one device independent graphical user interface 
component with the intermediate representation (i.e. "Dynamic Interfaces are interfaces 
that are generated on-the-fly and are usually custom-made for each user or device. 
There are two reasons why dynamic interfaces are becoming very popular. First there is 
a plethora of devices available in the market today and users maybe accessing an 
application with anyone of them" Page 10). 



Application/Control Number: 09/966,185 Page 5 

Art Unit: 2174 

In regards to claim 6, Abrams teaches a method dependent on claim 1 , wherein 
a) comprises instantiating the intermediate representation with a server computer (i.e. 
"A ill ML document can be used in one of several ways. First, it can be stored on a 
server (see Figure 1). When a user invokes an application, the UIML document either is 
compiled to a target platform's language (e.g., to WML, or to C++), or it is interpreted 
while the user interacts with the interface." Page 3). 

In regards to claim 7, Abrams teaches a method dependent on claim 1 , wherein 

a) comprises transmitting the intermediate representation to a server computer (i.e. 
"Figure 1 , Page 4, "User Profile"). 

In regards to claim 8, Abrams teaches a method dependent on claim 7, wherein 

b) comprises transmitting the customized intermediate representation from the server 
computer to said one of the heterogeneous device platforms (i.e. "Figure 1 , Page 4, 
"UIML and WML"). 

In regards to claim 9, Abrams teaches a method dependent on claim 1 , wherein 
a) comprises hierarchically representing a plurality of tasks with the intermediate 
representation (i.e. "The enumeration of parts is given in a hierarchical form, to 
designate the logical structure of the interface." Page 4). 

In regards to claim 10, Abrams teaches a method of scaling an application 
graphical user interface for display on a display screen of any of a plurality of 
heterogeneous device platforms, the method comprising: 

a) instantiating a logic structure from a device platform independent application 

graphical user interface, the logic structure comprising at least one logical panel 
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and representation of at least one graphical user interface component interface 
(i.e. "UIML can be viewed as a meta- or extensible language, analogous to XML 
ill ML does not contain tags specific to a particular user interface toolkit (e.g., 
<WINDOW> or <MENU>). Instead, it uses a set of generic tags (e.g., <part>, 
<property>). As discussed earlier, UIML captures the elements that are common 
to any user interface: an enumeration of the user interface parts, events that 
occur for those parts, presentation style, content, and interconnection to 
application logic. The UIML author specifies instance and class names of their 
own choice for interface parts and events. These names are mnemonics for the 
interface implementor." Page 5); 

b) selectively retaining the at least one logical panel and the at least one 
graphical user interface component in the logic structure as a function of 
suitability of the at least one logical panel and the at least one graphical user 
interface component to one of the heterogeneous device platforms (i.e. "Second, 
UIML can be dynamically generated from a database (see Figure 3). An interface 
server can query the client for a list of device features and/or user preferences 
and dynamically generate the UIML code for the interface from a database query. 
The user gets a tailored Ul that takes advantage of the technologies supported 
by the device without overloading the network or the device with unsupported 
code" Page 11); 

c) configuring the at least one logical panel and the at least one graphical user 
interface component in a layout compatible with the capabilities of a display 
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screen of said one of the heterogeneous device platforms (i.e. "Second, UIML 
can be dynamically generated from a database (see Figure 3). An interface 
server can query the client for a list of device features and/or user preferences 
and dynamically generate the UIML code for the interface from a database query. 
The user gets a tailored ill that takes advantage of the technologies supported 
by the device without overloading the network or the device with unsupported 
code" Page 11); and 

d) extracting the at least one graphical user interface component and the at least 
one logical panel from the logic structure (i.e. "Compilation on the server side is 
mandatory for devices that cannot download applications, such as cellular 
phones, and where memory is limited. Interpretation is more flexible; for example 
our Java interpretive renderer permits the entire UIML interface to appear as a 
Java bean, so that the interface may be manipulated programmatically by the 
application logic" Page 3). 

In regards to claim 1 1 , Abrams teaches a method dependent on claim 10, further 
comprising e) displaying a device platform dependent application graphical user 
interface on the display screen as a function of the at least one graphical user interface 
component and the at least one logical panel extracted from the logic structure (i.e. 
Figure 1, Page 4). 

In regards to claim 12, Abrams teaches a method dependent on claim 10, 
wherein a) comprises specifying properties comprising layout parameters of the logic 
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structure with the device independent application graphical user interface interface (i.e. 
"ill ML can be viewed as a meta- or extensible language, analogous to XML. ill ML does 
not contain tags specific to a particular user interface toolkit (e.g., <WINDOW> or 
<MENU>). Instead, it uses a set of generic tags (e.g., <part>, <property>). As 
discussed earlier, UIML captures the elements that are common to any user interface: 
an enumeration of the user interface parts, events that occur for those parts, 
presentation style, content, and interconnection to application logic. The UIML author 
specifies instance and class names of their own choice for interface parts and events. 
These names are mnemonics for the interface implementor." Page 5). 

In regards to claim 13, Abrams teaches a method dependent on claim 10, 
wherein b) comprises removing the at least one graphical user interface component 
from the logic structure as a function of tasks unsuitable to said one of the 
heterogeneous device platforms (i.e. "Second, UIML can be dynamically generated from 
a database (see Figure 3). An interface server can query the client for a list of device 
features and/or user preferences and dynamically generate the UIML code for the 
interface from a database query. The user gets a tailored Ul that takes advantage of the 
technologies supported by the device without overloading the network or the device with 
unsupported code" Page 1 1 ). 

In regards to claim 14, Abrams teaches a method dependent on claim 10, 
wherein a) comprises specifying retention of the at least one logical panel within the 
logic structure with the device platform independent application graphical user interface 
(i.e. "Second, UIML can be dynamically generated from a database (see Figure 3). An 
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interface server can query the client for a list of device features and/or user preferences 
and dynamically generate the UIML code for the interface from a database query. The 
user gets a tailored ill that takes advantage of the technologies supported by the device 
without overloading the network or the device with unsupported code" Page 11). 

In regards to claim 15, Abrams teaches a method dependent on claim 10, 
wherein a) comprises specifying a suggested layout structure for the at least one logical 
panel and the at least one graphical user interface component with the device platform 
independent application graphical user interface (i.e. "UIML can be viewed as a meta- 
or extensible language, analogous to XML UIML does not contain tags specific to a 
particular user interface toolkit (e.g., <WINDOW> or <MENU>). Instead, it uses a set of 
generic tags (e.g., <part>, <property>). As discussed earlier, UIML captures the 
elements that are common to any user interface: an enumeration of the user interface 
parts, events that occur for those parts, presentation style, content, and interconnection 
to application logic. The UIML author specifies instance and class names of their own 
choice for interface parts and events. These names are mnemonics for the interface 
implementor" Page 5). 

In regards to claim 17, Abrams teaches a method dependent on claim 10, 
wherein a) comprises specifying layout constraints for the at least one graphical user 
interface component with the device platform independent application graphical user 
interface (i.e. "Appendix. A Complete UIML Example Figure 4 shows two possible 
renderings of the credit card template. On the left is a Java-AWT dialog and on the right 
is a WML card." Pages 12-15). 
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In regards to claim 18, Abrams teaches a method dependent on claim 10, 
wherein a) comprises specifying layout groups of the at least one logical panel with the 
device platform independent application graphical user interface (i.e. "Appendix. A 
Complete UIML Example Figure 4 shows two possible renderings of the credit card 
template. On the left is a Java-AWT dialog and on the right is a WML card." Pages 12- 
15). 

In regards to claim 19, Abrams teaches a method dependent on claim 10, 
wherein a) comprises specifying a label for the at least one logical panel with the device 
platform independent application graphical user interface (i.e. "Appendix. A Complete 
UIML Example Figure 4 shows two possible renderings of the credit card template. On 
the left is a Java-AWT dialog and on the right is a WML card.", Pages 12-15, especially 
the code). 

In regards to claim 20, Abrams teaches a method dependent on claim 10, 
wherein d) comprises accessing a scalable graphical user interface library to obtain the 
at least one graphical user interface component (i.e. "This paper highlights two aspects 
of UIML: the ability to generate user interfaces for different platforms (we give example 
for Java AWT, WML, and VoiceXML), and the ability to construct a library of reusable 
interface components." Page 1). 

In regards to claim 21, Abrams teaches a method dependent on claim 10, 
wherein d) comprises downloading the at least one graphical user interface component 
from a server computer (i.e. "Figure 1 , Page 4, "UIML and WML").. 
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In regards to claim 22, Abrams teaches a scalable graphical user interface 
architecture for scaling an application graphical user interface to the display screen of 
any of a plurality of heterogeneous device platforms, the scalable graphical user 
interface architecture comprising: a target device platform comprising a display screen 
(inherent in Abrams); a device platform independent application graphical user interface 
operable within the target device platform to initiate creation of an instance of an 
intermediate representation of the device platform independent application graphical 
user interface (i.e. "UIML can be viewed as a meta- or extensible language, analogous 
to XML UIML does not contain tags specific to a particular user interface toolkit (e.g., 
<WINDOW> or <MENU>). Instead, it uses a set of generic tags (e.g., <part>, 
<property>). As discussed earlier, UIML captures the elements that are common to any 
user interface: an enumeration of the user interface parts, events that occur for those 
parts, presentation style, content, and interconnection to application logic. The UIML 
author specifies instance and class names of their own choice for interface parts and 
events. These names are mnemonics for the interface implementor." Page 5); a 
customizing module operable to customize the intermediate representation as a function 
of the capabilities of the target device platform (Figure 1, Page 4, "Interface Server"); 
and a render manager module operable to produce a device platform dependent 
application graphical user interface on the display screen as a function of the 
customized intermediate representation (Figure 1, Page 4, "Renderer"). 

In regards to claim 23, Abrams teaches a scalable graphical user interface 
architecture, further comprising a scalable graphical user interface library operable with 

A 
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the device platform independent application graphical user interface to create the 
instance of the intermediate representation (i.e. "This paper highlights two aspects of 
UIML: the ability to generate user interfaces for different platforms (we give example for 
Java AWT, WML, and VoiceXML), and the ability to construct a library of reusable 
interface components" Page 1). 

In regards to claim 24, Abrams teaches a scalable graphical user interface 
architecture, wherein the customizing module comprises a task manager module 
operable to retain tasks applicable to the functionality of the target: device platform and 
the display screen (i.e. "Second, UIML can be dynamically generated from a database 
(see Figure 3). An interface server can query the client for a list of device features 
and/or user preferences and dynamically generate the UIML code for the interface from 
a database query. The user gets a tailored Ul that takes advantage of the technologies 
supported by the device without overloading the network or the device with unsupported 
code" Page 11). 

In regards to claim 25, Abrams teaches a scalable graphical user interface 
architecture, wherein the customizing module comprises a transformation manager 
module operable to configure the layout structure of the display as a function of 
properties specified by the device platform independent application graphical user 
interface (i.e. "Second, UIML can be dynamically generated from a database (see 
Figure 3). An interface server can query the client for a list of device features and/or 
user preferences and dynamically generate the UIML code for the interface from a 
database query. The user gets a tailored Ul that takes advantage of the technologies 
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supported by the device without overloading the network or the device with unsupported 
code" Page 11, Also See Figure 1, Page 4). 

In regards to claim 26, Abrams teaches a scalable graphical user interface, 
wherein the scalable graphical user interface library comprises a user interface event 
translator module, the user interface event translator module operable to translate a 
graphical user interface event generated by the target device platform to an action 
compatible with the device platform independent application graphical user interface 
(i.e. See Figure 1, Page 4, the renderer translates the general GUI into a GUI 
customized for the specific device). 

In regards to claim 27, Abrams teaches a scalable graphical user interface 
architecture, wherein the intermediate representation comprises at least one logical 
panel and representation of at least one graphical user interface component (i.e. "UIML 
can be viewed as a meta- or extensible language, analogous to XML. UIML does not 
contain tags specific to a particular user interface toolkit (e.g., <WINDOW> or 
<MENU>). Instead, it uses a set of generic tags (e.g., <part>, <property>). As 
discussed earlier, UIML captures the elements that are common to any user interface: 
an enumeration of the user interface parts, events that occur for those parts, 
presentation style, content, and interconnection to application logic. The UIML author 
specifies instance and class names of their own choice for interface parts and events. 
These names are mnemonics for the interface implementor" Page 5). 

In regards to claim 28, Abrams teaches a scalable graphical user interface 
architecture, wherein the target device platform comprises one of a pager, a wireless 
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phone, a personal digital assistant, a hand-held personal computer, a vehicle navigation 
system and a notebook personal computer (Figure 1 , Page 4, Device #1 and Device 
#2). 

In regards to claim 29, Abrams teaches a scalable graphical user interface 
architecture, wherein the device platform independent application graphical user 
interface is compatible with, but device platform independent of any of the 
heterogeneous device platforms (i.e. "An objective of UIML is to permit a UIML 
document to be mapped to any type of user interface, from graphical to speech, and 
even to those not yet invented. UIML represents an interface in five parts: the interface 
structure, presentation style, content (words, images, sounds), actions taken in 
response to user interaction, and interconnection of the interface to application logic." 
Page 1). 

In regards to claim 30, Abrams teaches a scalable graphical user interface 
architecture wherein the target device platform comprises any, one of a plurality of 
heterogeneous device platforms (i.e. "An objective of UIML is to permit a UIML 
document to be mapped to any type of user interface, from graphical to speech, and 
even to those not yet invented. UIML represents an interface in five parts: the interface 
structure, presentation style, content (words, images, sounds), actions taken in 
response to user interaction, and interconnection of the interface to application logic." 
Page 1). 



Claim Rejections - 35 USC § 103 
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The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

Claim 16 is rejected under 35 U.S.C. 103(a) as being unpatentable over Abrams, 
Marc et al. ("UIML: An XML Language for Building Device-Independent User 
Interfaces") in view of Shirakawa (US 5956738). 

In regards to claim 16, Abrams teaches all the limitations of claim 10. He does 
not teach a method comprising specifying a layout priority for the at least one logical 
panel with the device platform independent application graphical user interface. 
Shirakawa teaches, "The allocation section 106 refers to the article layout order 125 
read out from the layout data group storage 105 and checks whether the article with the 
highest layout priority among the articles not yet allocated to any column can be 
selected as the processing subject or not (Step 1201)." It would have been obvious to 
one of ordinary skill in the art at the time of the invention to modify Abrams with the 
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teachings of Shirakawa and include a method of specifying the layout priority with the 
motivation to better display the most important features on the device. 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

US005583983A Schmitter 

Teaches a multi-platform object-oriented software development and deployment 



Teaches development and validation of multi-platform and multi-standard website 
layouts, this embodiment comprises the steps of storing a plurality of rendering 
algorithms each associated with a predefined graphic user interface standard, 
accessing a data repository storing an instruction set for constructing a graphic 
user interface layout through a network connection, rendering an image of the 
graphic user interface layout associated with the instruction set for each of the 
plurality of rendering algorithms, reducing the image of the graphic user interface 
layout to a bitmap image, and displaying the bitmap image for each of the 
plurality of rendering algorithms. 



system. 



US006353448B1 



Scarborough et al. 
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Farooq, Ali. "Simplifying Construction of Multi-Platform User Interfaces Using 
UIML" March 2001 
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